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© Method and apparatus for inspecting the appearances of articles. 


A method and apparatus for inspecting appear- 
ances of article s, comprising reflecting images of 
four different side surfaces of an article (2) being 
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transported on a conveyor (1) on a plurality of re- 
flecting means arranged above and at both sides of 
a conveying path on the conveyor (1) to transmit the 
four images onto a sensor surfac e of a sensor cam- 
era (3) r espectively, reflecting an image, of a top 
surface of the article (2) onto the sensor surface of 
the sensor camera in the array with the four images, 
and scanning and photographing the images of five 
different surfaces of the article (2) formed on the 
sensor surface of the sensor camera.. (3) by the 
sensor camera (3) at every preset amount of move- 
ment of the article (2) . synchronized with the con- 
veyor (1), an d processing the photographed images 

insgMgc t ^ f prmSy ... sizes and 


so as Jo measure and 
surfa ce c onditions of" tn 
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one sensor camera (31 at the same time. The meth- 
od and apparatus can cover five of the six partial 
surfaces, front and rear, right and left, and upper and 
lower, of an article, that is. 5/6 = 83% of the whole 
surface of an article (2) reliably in the inspection of 
surface conditions. 
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"Method and apparatus for inspecting the appearances of srticies" 


Background of the Invention: 

Field of the Invention: 

The present invention re-ares to a method and 
ar. apoaratus for inspecting *he appearances of 
artic:es, particularly a methoo and an apparatus tor 
measuring and inspecting the forms, sizes and 
surface conditions (such as colors, damages, sur- 
face ruggedness, etc.) of artides, for example, ball 
iike fruits, vegetables or the like, by photographing 
the articles by means of a sensor camera and 
processing their pictures so as to sorting them by 
classifying and grading. ^ • 


Description of the Related Art 

Conventionally, the following apparatuses have 
been provided which inspect the forms, sizes and 
surface conditions of fruits, vegetables or the iike 
by using a sensor camera or sensor cameras: 

(a) Apparatuses using the inspecting method 
wherein a sensor camera placed above or at one 
side of a conveyor photographs the one-sided sur- 
face of each fruit, vegetable or the like being con- 
veyed; 

(b) Apparatuses using the inspecting . method 
wherein two sensor cameras placed at both sides 
of a conveyor photograph the two-sided surface of 
each article being conveyed: 

(c) Apparatuses using the inspecting method 
wherein four sensor cameras placed at both sides 
of a conveyor photograph the four-sided surface of 
each article such as fruit or vegetable dropped 
from the other conveyor onto that conveyor; and 

(d) Apparatuses using the inspecting method 
wherein a sensor camera placed above a roller 
conveyor photographs the peripheral part of each 
article such as fruit or vegetable being conveyed 
on rotating at a high speed in the conveying direc- 
tion. 

To sort ball like articles such as fruits or vege- 
tables {hereinafter referred to as "articles") by clas- 
sifying and grading according to the form, size and 
surface conditions (such as colors, damages, etc.), 
<t is very important to inspect the parts of each 
article representing the form and size thereof as 
well as the peripheral surface of the article. 

However, the conventional techniques as de- 
scribed aDove cannot satisfy these requirements. 


The method (a) cannot sort articles correctly, 
because it can inspsr only the top or one-sided 
surface of each article, that is, the limited surface 
of the article, leavtnc :ne large part of its overall 
5 surface not inspecrac 

The metrca b? inspect ooth sides of the 
article, that »c i or>r pan of rts overall surface 
than the mer>CG \a,. However, the method (b) 
cannot sort arncies correctly, because the large 
w parts of their surraces are left not inspected. Espe- 
_ daily, an article like lemon which present different 

forms and sizes of its images according to its 

orientation cannot be correctly measured and in- 
spected, because it presents different images in 
75 size between when its axis is placed in the cros- 
swise direction of the conveyor and when it is in 
the longitudinal direction of the conveyor. There- 
fore, it is required to aiign all articles of this type in 
the same orientation on the conveyor. 
20 However, :t is very difficult to aiign all articles 
automatically in the same orientation on the con- 
veyor. 

The method (c) can inspect ail four sides of an 
article, that is, a larger part of its surface than the 

25 method (b). However, this method presents the 
disadvantages that the upper and lower parts of the 
article surface in the dropping direction cannot be 
inspected and that the part of the article represent- 
ing the size of the article cannot be measured in 

30 form and size, because the orientation of the article 
cannot be effectively controlled. 

The method (d) presents the disadvantages 
that although it can inspect the peripheral or side 
surface of an article iike lemon which can be rotat- 


35 ed aroun dJts_core axis in a high circumferential^ 
speed, the end parts of the article in the axial 
direction are left not inspected, that it tends to 
swing and jump the article in the unstable position 
during the conveying by rollers so that it. is not 

40 practically applicable to such articles, and that a 
small article may be rotated by a turn or more in 
the same photographing period so that a part of its 
surface is repeatedly inspected, while a big article 
may be rotated by less than a turn in the same 

45 photographing time so that a part of its surface is 
left not inspected. " v ' > *' ^ ^ 

Since the articles having different circumfer-^ 
ences cannot be rotated by a turn' at the same time 
on the same roller conveyor, the . rate bf : circum- 

50 ferential rotation depending upon the circumference- 
of the article makes the inspected areas of articles " 
different from each other. 
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The methods (c) and (d) which can inspect the 
larger area of an article than the methods (a) and 
(b) present the disadvantage that they tends to 
deteriorate the commercial value (marketability) of 
articles by giving damages such as bruises or 
scratches during the dropping or the high-speed 
rotations of articles. 

In addition, the methods (c) and (d) cannot 
measure in form and size the part of an article 
representing the size of the article, because the 
articles cannot be kept in the same orientation. 

The methods which use a plurality of sensor 
cameras such as the method (c) are complicated 
and expensive. 

To measure and inspect the whole surface of a 
bail like article, it is preferable that at least the front 
and rear parts, right and left parts, and upper and 
lower parts of an article are inspected. 

To inspect the six parts of an article, the article 
may be suspended, or transported on a transparent 
conveyor. However, the suspension presents the 
same disadvantages as the method (c), and is not 
practically applicable. A transparent conveyor may 
be opaquely stained in its transparent parts during 
the transportation of articles so that it is not ap- 
plicable to an inspecting apparatus for many arti- 
cles. 

Articles such as fruits and vegetables tend to 
be given more damages such as bruises and 
scratches on their surfaces, as they are involved in 
more processes of dropping or rotations. Therefore, 
it has been desired to develop a method and 
apparatus which can inspect the larger surface part 
of each article without dropping or rotating articles. 

Summary of the Invention: 

An object of the present invention is to elimi- 
nate the disadvantages of the conventional tech- 
niques. - 

Another object of ' the present invention is to 
provide a method and an apparatus which can 
measure and inspect ball like articles being trans- 
ported in the stable position on a conveyor by 
using a sensor camera,, especially the form and 
size of the part of each article representing the size 
thereof as well as the conditions of the whole 
exposed surface of the article except for the lower 
part thereof in contact with the conveyor. 


Detailed Description of the Invention: 

To attain these objects, the present invention 
uses means as described below, 
5 A belt conveyor having a continuous conveying 

face in the same plane may be used as means for 
carrying ball like articles so as to facilitate the 
automatic feed of articles. 

This belt conveyor has no compartment in the 
70 running direction so that articles can be placed on 
the conveyor at any given position, and can pro- 
vide the automatic supply of articles one after 
another. 

To stabilize the ball like articles which tend to 

75 roll out, it is preferable that the conveying face is 
concavely formed in the central part to the extent 
that the side surface of each article can be photo- 
graphed without any obstacle. The most preferable 
is, for example, a sorting conveyor as described in 

20 the Japanese Laid-Open Patent Application No: 
Sho 58-135026. 

The conveying means may be designed by 
using a conveyor as described above so that it can 
provide the automatic supply of articles at random, 

25 . the articles being indefinitely spaced between each 
other by not smaller than the predetermined dis- 
tance below which the photographing operation of 
the sensor camera is prevented. 

One of the generally known color sensor cam- 

30 eras ma y be placed above the conveying path to 
measure and irjsosci tfafi ^rm <;j ? o g nc j surface 
conditions (SBlflft H; vnaqes, e tc.) of each article 
being transported. Preferably, the color sensor 
camera which contains solid image sensors, to 

35 prevent any after-image phenomenon is used to 
photograph running articles sequentially. 

Either of area image sensors and linear image 
sensors may be used. However, the sensor camera 
which contains linear image sensors is preferably 

40 used, because the linear image sensors permit to 
mount easily lighting means for the partial surfaces 
of an article as described hereinafter as well as 
reflecting means for the partial surfaces of the 
article, and to minimize the distances between arti- 

45 cles in the running direction thereof. 

The most preferable is the sensor camera 
which contains the high-speed h igh -se^ 
CCD linear image senapj^^ 
chip fo rmed at the light recejver part of the sensor, 

so which are generally used, for example, for the color 
scanner of a color facsimile or a color, copying 
machine, ' : '\ 

Various reflecting means (surface reflecting 
mirrors, prisms or other optical mirrors) that permit 

55 the sensor camera placed above the conveying 
path :to take the four side images and one top 
image of the article being transported on the con- 
veying path are placed between the sensor camera 
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and the both sides of the conveying path under ^he 
sensor camera at the inspecting position (or place}, 
as described below, to reflect the four side (front 
and rear, right and left) images and one top :mage 
of the article onto the sensor surfaces of the sensor 5 
camera respectively in sequence. 

Since tne front and rear sides (in the running 
direction) of the article being transported fcy a 
conveyor are always cr the conveying vaefc. trs 
reflecting means (hereinafter re^errec 10 as . w 
"mirrors ") cannot be piaced at the rront ana -ear cf 
the article in the running direction. According to the 
present invention, therefore, the whoie side surface 
of an article is divided in four pans by the center 
lines of the' article in the running direction and in 75 
the direction perpendicular thereto; a left front side, 
a right front side, a left rear side and a right rear 
side. To reflect the four side images of the article 
onto the sensor camera, a set of . four first mirrors 
almost vertically mounted, a set of four second 20 
mirrors facing upward, and a set of intermediate 
mirrors facing to the sensor camera are piaced in 
position. 

The top surface of the article may be photo- 
graphed directly by the sensor camera through its 25 
lenses. However, the shooting distance is different ' 
between the top image of the article and the four 
side images of the article which are taken through 
four sets of side mirrors for reflecting and refract- 
ing. Therefore, the shooting distances may be cal- 30 
culated by compensating the magnifications ac- 
cording to the difference of the shooting distance 
during the image processing. This compensation is 
a image plane inversion. 

For these reasons, it is preferable that a plural- 35 
ity of reflecting and refracting mirrors are used and 
arranged so that the five partial surfaces of the 
article can be reflected on the sensor surfaces of 
the sensor camera at the same magnification (or 
the same shooting distance). 40 

The present invention will be detailed below by 
referring to Fig. 1 showing a preferred embodiment 
of the presegjUnvention as described hereinafter. 

,n Fig.Qy the four arrow-marked lateral lines 
and the arrow-marked upward line extending from 45 
the article placed at the center of the inspecting 
position toward the sensor camera through refrac- 
tions show the routes of reflecting beams transmit- 
ted from the five partial surfaces of the article to " 
the sensor camera. 50 

The first side mirrors are placed at the first 
refraction points of the four arrow-marked lines 
extending frorn the four side surfaces of the article 
respectively, the second- side mirrors are at the 
second refraction points respectively, the third side 55 
mirrors are at the third refraction points respec- ■ 
tively, and the forth side mirrors are at the forth 
refraction points respectively, facing to the sensor 
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camera. Similarly, the f'rsi top mirror, the second 
top mirror and the thira top mirror are placed at the 
three refraction points of the arrow-marked line 
extending from the top surface of the article re- 
spectively, the third top mirror facing to the sensor 
camera. 

The first side mirrors facing directly to the four 
sida surfaces of the article respectively have a 
ht'cnt equai cr greaier trar. mat of the biggest 
ai!C:'e, ana ^re ciacea aim-si vertically. These 
errors refrac; ana .-erlect Ire c earns coming from 
the rour side surfaces of the article onto the second 
side mirrors which are inclinedly placed at both 
sides of the conveying path in parallel thereto. 
Namely, the first side mirrors provide the reflecting 
means which reflect the side images of the article 
on the conveying path onto the second side mirrors 
at both sides of the conveying path. 

The second side mirrors, which are inclinedly 
piaced at both sides of the conveying path in 
parallel thereto between the first front and rear side 
mirrors respectively, reflect the side images of the 
article coming from the first side mirrors onto the 
third side mirrors placed above the second mirrors 
respectively. Namely, the second side mirrors pro- 
vide the reflecting means which direct the horizon- 
tally directing images upward. The lower ends of 
the second inclined side mirrors are nearer to the 
first side mirrors and on the same level with the 
lower ends of the first side mirrors respectively, 
while the higher ends of the second inclined side 
mirrors are farther from the first side mirrors and 
on the same level with the higher ends of the first 
side mirrors respectively. Thus, the whole surfaces 
of the first side mirrors are reflected onto the third 
side mirrors through the second side mirrors re- 
spectively. 

Each of the third side mirrors reflect the two 
side images of the article coming from the two 
corresponding second side mirrors onto the cor- 
responding forth side mirrors which are placed 
within the field of the sensor camera. Namely, the 
third side mirrors provide the reflecting means 
which direct the side images of the article coming 
from the two second side mirrors at each right or 
left side of the conveying path into the field of the 
sensor camera. 

Each of the forth side mirrors directs the two 
side images -of the article reflected from, the, cor- 
responding third side mirrors to the front face of 
the sensor camera. Combined with the third side 
mirrors, the forth side mirrors are adjustable in 
orientation so that the four side images of the 
article can be aligned in the field of the sensor 
camera. Particularly, the forth side mirrors are ad- 
justed so that the four side images of the article 
are received by the sensor surfaces of the sensor 
camera in the corresponding positions. 
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The first, second and third top mirrors which 
reflect the top image of the article refract the 
reflected beam to form the image in the same 
magnification (at the same shooting distance) as 
that of the four side images. Assuming that the 
iength of the arrow-marked lines extending laterally 
from the article at the center of the inspecting 
position to the sensor camera through the first, 
second, third and forth reflecting and refracting 
side mirrors respectively is the shooting distance 
for the four side images and that the length of the 
arrow-marked line extending upward from the arti- 
cle to the sensor camera through the first, second 
and third reflecting and refracting top mirrors is the 
shooting distance for the top image, the side and 
top mirrors are arranged so that the shooting dis- 
tance for the top image is equal to that for the four 
side images. It is understood that the third top 
mirror is adjusted in orientation so that the top 
image can be formed on the sensor surfaces of the 
sensor camera in the allotted position. 

if linear jmage sensors are used in the sensor 
camera; the top and side images are align ecj on 
the image sensors according to the image forma- 
tion principle for the incident beam in the sensor 
camera, as shown in Fig. 5. Particularly, the top 
image is placed at the center, the left and right 
front side images are at both ends, and the left and 
right rear side images are between the top image 
and the left and right front side images. 

According to the arrangement of the images as 
described above, linear image sensors are allotted 
to the five images. 

The linear image sensors scan, form and pro- 
cess the five images with a pulse signal delivered 
at the preset rate of movement (for example, 
0.5mm) synchronously with the running conveyor. 

It should be noted that since the four first 
vertical side mirrors face to the center of the in- 
specting position at the right and left front and rear 
sides of the article respectively relative to the run- 
ning direction of the conveyor, that is, they are 
allotted to the 1/4 parts, of the peripheral article 
surface, as described above, the four side mirrors 
receive within their fields part of the beams coming 
from the irrelevant side surfaces of the article 
(adjacent to the respectively allotted side surfaces) 
both before the front end of the article reaches the 
center point of the inspecting position and after the 
rear end of the article has passed over the center 
point, and that the four side images of the article 
formed by the sensor camera through the reflecting 
mirrors are thus elongated with the added parts in 
the form or a crescent, though the heights of the 
side images are correctly displayed. These elon- 
gated parts of the side images are. ignored during 
the image processing, because they are' contained 
in the adjacent images to be inspected. 


The side images are used mainly for the in- 
spection of surface conditions, and used also for 
the measurement of article heights. 

The present invention will be described below 

5 by using an area image sensor camera. 

I f an areajmage sensor camera is used, the 
reflecting means are large"ehbugh "to reflect the 
whole image of the article placed at the center of 
the inspecting position, and the sensor camera 

id shoots the five partial surfaces of the article at the 
same moment by the aid of the shutter means. The 
sensor camera does not shoot the article out of the 
center in the inspecting position, but it shoots the 
article just at the center of inspecting position by 

75 operating the shutter means. 

Since the area image sensor camera contains 
larger reflecting means and has a square field of 
view, it is necessary to install lighting lamps far 
from the field of the camera. 

20 The known arts as described in the Japanese 

Laid-Open Patent Application No. Sho 59-87081, 
may be applied to the measurement of forms and 
sizes, the inspection of colors and damages, and 
the sorting of articles. 

25 

Brief Explanation of the Drawings: 

All the drawings annexed hereto show the em- 
30 bodiments of the present invention. 

Fig. 1 is a perspective view showing the 
configuration of the apparatus according to the 
present invention. 

Fig. 2 is a perspective view showing the 
as center of the. inspecting position and the reflecting 
means according to the present invention. 

Fig. 3 is a schematic view illustrating the 
principle of shooting the left front side of an article 
according to the present invention. 
40 Fig. 4 is a schematic view illustrating the 

principle of shooting the top. of an article according 
to the present invention. 

Fig. 5 is a schematic view illustrating the 
linear image sensors on which the five images of 
45 an article are allotted. 

Fig. 6 is a schematic view illustrating the five 
images of an article. 

Figs. 7 to 11 are schematic views illustrating 
the processes where an article 1 in the- inspecting 
so position passes through the field of a sensor cam- 
era. Fig. 7 shows the conditions where an article is 
about to enter- the field of the camera. Fig. 8 shows 
the conditions where the front end : of- the article * 
reaches the center of the inspecting position and 
55 where the top surface of the article starts to be 
shot. Fig. 9 shows the conditions where the five 
partial surfaces of an article are shot by the cam- 
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era. Fig. 10 snows the conditions where the top of 
the article nas been shot Fig. 11 shows the con- 
ditions where the article is going out of the field. 

Fig. 12 is a schematic view showing the five 
partial surfaces of an article to be shot. 5 

Fig. 13 is a schematic view showing the 
apparatus containing lighting means according to 
the present invention. 

Fig. 14 a side view illustrating the main 
3£rt of the apparatus containing lighting means *c 
according ;c the present invention. 

Fig- 15 is a perspective view showing the 
whole of the apparatus containing lighting means 
according to the present invention. 

Detailed Description of the Preferred Embodiments: 

The present invention wll be described in de- 
tail by referring to the drawings showing the pre- ' 20 
ferred embodiments of the present invention. 

Figs. 1 and 2 are schemaiic views illustrating 
the presentjnvention. 

Ir F,g (jJ 1 is a conve y° r ' 2 is an article (a fruit 
in this figure), and 3 is a sensor camera. - 25 

The conveyor 1 as shown in the figures is as 
described, in the Japanese Laid-Open Patent Ap- 
plication No. Sho 58-135026. However, any other 
type of conveyor such as a belt conveyor or sorting 
conveyor may be used. 30 

: A, 5, 6 and 7 §£ejhej^rs^ which 
reflect the four side surfaces 2A, 2B, 2C and 2D of 
an article 2, and 41 , 51 , 61 and 7± are ,the^ second 

The first side mirrors 4, 5, 6 and 7 are placed 35 
so that the images on them are reflected on the 
second side mirrors 41, 51, 61 and 71 respectively, 
which are placed at both sides of the conveying 
path in parallel therewith and inclined upward at 
their ends nearer to the center point 20 of the 40 
inspecting position, as shown in Fig. 2. 

Since the sensor camera 3 contains linear im- 
age sensors 31 in this embodiment, the fieid of the 
camera is formed by the vertical planes on the 
lines 24A, 258, 26C and 27D connecting the center 45 
of the inspecting position and the first side mirrors, 
4, 5, 6 and 7 respectively. The side surfaces of the 
article 2 being transported by the conveyor 1 within 
the field, of view are reflected on the first side 
mirrors 4. 5, 6 and 7 and the second inclined side so 
mirrors. 41, 51, 61 and 71 respectively.. 

The first side mirrors 4 and 5 are placed, down- 
stream at the left and right sides of the center point 
20 in the inspection position on the conveying path 
respectively as seen from the upstream side of the 55 
conveying path. The first mirror 4 reflects the left" 


front side 2A of the article 2 onto the second side 
mirror 41. The first side mirror 5 reflects the right 
front side 2B of the ancle 2 onto the second side 
mirror 51. 

The first side mirrors 6 and 7 are placed Up- 
stream at the left ana r-ght sides of the center 20 of - 
the inspecting position respectively as seen from 
the upstream side of *r e conveying path. The first 
side mirror 6 refi-cts The left rear s:-e 2Z of the 
article 2 onto the second side mirrcr =\ a^d the 
first side mirror 7 refers the right rear 3ioe 2D of 
the articled onto the second side mirror 71. 

The first side mirrors 4, 5, 6 and 7 are at least 
as high as the highest article 2. 

The lower ends of .the second inclined side 
mirrors 41, 51, 61 and 71 are on the same level 
with the lower ends of the first side mirrors 4, 5 6 
and 7 respectively. The upper ends of the second 
side mirrors 41, 51, 61 and 71 are positioned at the 
middle points between the set of the first side 
mirrors 4 and 5 and the set of the first side mirrors 
6 ana 7 respectively (at both sides or the center 
point 20), and on the same level with the upper 
ends of the first side mirrors 4, 5, 6 and 7 respec- 
tively. The second side mirrors 41 , 51, 61 and 71 
reflect the reflected beams 4A, 5B, 6C and 7D from 
the first side mirrors 4, 5, 6 and 7 onto the third 
side mirrors 46 and 57 placed above the first and 
second side mirrors respectively. 

The third sipe ;mtrrnrs flg [_* which are 
placed nearer the sensor camera 3 than the article 
2 and have a smaller field of view, receive the 
reflected beams from the four second side mirrors, 
that is, two each. 

Particularly, the partial surfaces 46A and 46C 
of the third side mirror 46 receive the left front and 
rear side reflected beams 41 A and 61 C from the 
second side mirrors 41 and 61 respectively, while 
the partial surfaces 57B and 57D of the third side 
mirror 57 receive the right front and rear side 
reflected beams 51 B and 71 D from the second 
side mirrors 51 and 71 respectively, as shown in 
the figures. 

' The .third side mirrors 46 and 57 reflect the 
reflected beams 41 A, 61 C. 51 B and 71 D onto the 
forth side mirrors 461 and 571 respectively, which 
are placed within the field of the sensor camera 3 
above the conveying path. : s.\ . : 

- As: it : ; is shown in the figures, the ■• < forth * side 
mir ; r 9fT ^1 qnr| [T 57^reflect : the 'reflected beams 
- from r the - third* side mirrors. 46 and 57 onto the 
linear, image sensors 31 in the sensor camera 3 to 
form the images respectively.- 
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In reference to Hg(j£)he vertical image of the 
left front side of the article 2 formed on the first 
side mirror 4 is reflected on the second side mirror 
41 and the third side mirror 46. The image on the 
third side mirror 46 is almost horizontal and parallel 
to the conveying path. 

The third side mirror 46 reflect the received 
image onto the forth side mirror 461. The image 
reflected from the forth side mirror 461 is shot by 
the sensor camera 3 as the image perpendicular to 
the conveying path or the running direction of the 
anicte 2. 

In reference to Rg^phe top surface 2E of the 
article 2 is shot by the s^o JL s^m§J^J m ^s~6^' 
scribed below. 

The first top mirror 8 is placed above the 
center 20 of the inspecting position to reflect the 
top surface 2E of the article 2. Particularly, the first 
top mirror 8 has a field of view as wide as the 
-conveying path on the conveyor 1, and it is placed 
so that the reflected beam 28E on the top surface 
2E of the article 2 t placed on the line 21 intersect- 
ing the running direction at the center point 20, is 
reflected by the first top mirror 8 toward the sec- 
ond top mirror 81 . 

The second top mirror 81 is placed so that the 
reflected beam 8E from the first top mirror 8 is 
reflected by the second top mirror 81 onto the third 
top mirror 82. 

The third top mirror 82 is placed on the same 
level with the forth side mirror 461 so that the 
reflecting surface 82E of the third top mirror 82 is 
almost horizontally aligned with and between the 
reflecting surface 461 A and 461 C of the forth side 
mirror 461 and the reflecting surface 571 B and 
571 D of the forth side mirror 571, as seen from the 
side of the sensor camera 3. 

Since the second top mirror 82 is provided 
simply to make the shooting distance equal to the 
length (or distance) of the reflected beams by the 
side mirrors, the position of the second top mirror 
82 in the running direction of the article 2 may be 
calculated in relation with that of the third top 
mirror 82. ' ^ 

In reference to RgQ^/ie four reflected beams 
extending from the center point 20 to the sensor 
camera 3 through the first, second, third and forth 
side mirrors respectively are as long as the re- 
flected beam extending from the center point 20 to 
the sensor camera 3 through the first second and 
third top mirrors, and the former and the latter are 
both within the focus depth of the sensor camera 3. 
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45 


J]}^B^SJ^tl3P^ n 9^ arns fr om the five oarriai 
surTaceF 2A, 2B, 2C ;tt J^^jg^^^^^ 


reach the 
camera 3 


linear 
where 


mage sensors 31 in the sensor 
^ :ne corresponding images are 

s formed on the sequence of positions (the surfaces 
of image sensors) A. 5. C. D and E as shown in 
Fig(5/espectiveiy. 

The pictures of :r,e five oap^l surfaces tnus 
shot are formed as shewn in FigfSj 
w The formed pictures are then measured and 

inspected by the known processing means. 

Particularly, the form and sizes of an article 
(diameter, major axis, minor axis, area, circum- 
ference, etc.) are calculated by the known image 
analysis from the top picture 2E. 

The height of an article is calculated as the 
average of the heights H A , H Bl H c and H D of the 
four side pictures 2A, 2B, 2C aodLgD. 

of a n article are inspected by the known process- 
ing means from the five pictures of the article. The 
peripheral part of each picture is contained also in 
the pictures of the adjacent surfaces (for example, 
the top picture of an article is partially contained in 
the side pictures of the article). Since the periph- 
eral parts of the pictures contain no information on 
the partial surfaces perpendicular to the partial 
surfaces corresponding to the pictures respectively, 
they may be preferably ignored on the image pro- 
cessing stag^ 

ln R 9/^/ ne four side pictures 2A, 2B, 2C and 
2D are moTS elongated than the real forms of the 
corresponding partial side surfaces 2A, 2B, 20 and 
2D of the article 2. The elongated parts a, b, c and 
35 d of the pictures 2A, 2B, 2C and 2D are pictures 
resulting from the facts that the left front side a and 
right front side b of the article 2 are reflected on 
the irrelevant first side mirrors 5, 6 and 4, 7, while 
the article 2 is moving from the entering point in 
the field of the side mirrors as shown in Fig. 7 to 
the shooting start point (the center point 20 of the 
inspecting position) as shown in Fig. 8. and that the 
left rear side c and right rear side d of the article 2 
are reflected on the irrelevant first side mirrors 4, 7 
and 5, 6, while the article 2 is moving from the top 
surface shooting end point as shown in Fig. 10 to 
the leaving point from the field of the side mirrors 
as shown in Fig. 11. These elongated parts a. b, c 
and d of the pictures are. not corresponding to the 
so pictures, to be inspected, .and,. may be -ignored 
during the image processing^. x;; .. ;v; , rv: . 

Similarly, the partial top, pictures contained, in 
the four side pictures may be ignored during the 
image processing because of their duplicate imag- 
55 ing. ... 
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Thus ^rocsssec, the five paniai surfaces cf tre 
article, exposed on the conveyor, can be inspected 
with reliability except for the bottom surface of the 
article 2 in contact with the conveyor 1 . 

If the sensor camera 3 contains linear image 
sensors 3T as in this embodiment, Jhe field of the 
camera is developed in the form of a curtain in five 
directions by refractions. Since there are dead 
soaces z^v^eerx reflecting beams, many small 
sighting ,a*-cs S may be orooerly arranged around 
me arnc;3 2 :o light the oartiat surfaces z' tne 
article 2 an^osi in the form of a ball. 

The small lighting lamps 9 thus arranged can 
light the whole surface of the article 2 except the 
bottom part thereof uniformly to permit of providing 
a clearer picture information. 

The distance between articles 2 being con- 
veyed will be described below from the conditions 
where the articte 2 passes over the inspecting 
position as sncwn in Figs. 7 to 1 1 . 

As it is- shown in Rg_ 7, such a distance 
between articles 2 is desirable that the right anc 
left rear sides of the preceding article 2' has been 
out of the intersecting fields of the first side mirrors 
4. 5, 6 and 7 when the right and left front sides a 
and b of the article 2 reach these intersecting 
fields, the two articles 2 and 2' being moving from 
right to left in the figure. 

In the other terms, it is preferable that the 
articles 2 and Z are sequentially positioned on the 
conveyor outside the two lines intersecting at the 
center point of the inspecting position, that is, it is 
sufficient that the distance between articles is 
equivalent to the length of the biggest article. 

Since the foregoing description and the draw- 
ings annexed hereto are related to one embodi- 
ment of the present invention, but not limited to it, 
it is understood that the plural reflecting means and 
the camera sensor as described in the claims may 
be provided in any other configuration. 

As' it has been described above, the present 
invention permits a sensor camera to shoot the top 
surface and four different side surfaces of an article 
at the -same time. Therefore, the present invention 
can cover five of the six partial surfaces, front and 
rear, right and left, and upper and lower, of an 
articl . that is, 5/6 = 83% of the whole surface of 
an article reliably in the inspection of surface con- 
ditions. ■-■<:■.'. 

In addition, the present invention can measure 
the sizes of articles from their top pictures as well 
as the heights of articles from their side pictures so 
as to classify articles by size and grade them more 
correctly. 

In shorOhe automatic sorting of fruits, vegeta- 
bles and other articles is realized by the present 
invention. 


Claims 

1. A method of inspecting appearances of arti- 
cles, comprising reflecting images of four different 

5' sice surfaces of an article being transported on a 
conveyor on a plurality of reflecting means ar- 
ranged above and at bcih sides of a conveying 
ca*;* on said conveyer to transmit the four images 
a sensor surface if i sensor camera respec* 

70 vveiv. reflecting an ^mage c- s top surface of sa»c 
.*jt'c!e onto the sensor surace of said sense cam- 
era ;n the array with saio tour images, and scan- 
ning and photographing :ne images of said five 
afferent surfaces of said article formed on said 

15 sensor surface of said sensor camera by said sen- 
sor camera at every preset amount of movement of 
said article synchronized with said conveyor, and 
orocessing the photographed images so as to mea- 
sure and inspect forms, sizes and surface con- 

20 ditions of said article by using only one sensor 
camera at the same time. 

2. A method according to claim 1 , wherein said 
four different side surfaces of said article include a 
left front side surface, right front side surface, left 

25 rear side surface and right rear side surface of said 
article, and wherein said plurality of reflecting 
means reflect the images of said four side surfaces, 
onto said sensor camera at the same magnification. 

3. A method according to claim 1 or 2, wherein 
30 said plurality of reflecting means which reflect the 

images of said four side surfaces onto said sensor 
camera include twelve reflecting means placed at 
right, left, front and rear sides of and above said 
article. 

35 4. A method according to any of claims 1 to 3, 

wherein the image of said top surface of said 
article is reflected by three reflecting means onto 
said sensor surface of said sensor camera in the 
array with said four side images at the same mag- 

40 nification. 3 

5. A method according to claim 1, wherein said 
sensor surface of said sensor camera includes a 
linear image sensor. 

6. A method according to claim 5, wherein the 
45 images of said four different side surfaces and the 

image of said top surface are reflected on said 
linear image sensors in array at. allotted positions 
respectively. 

7. A method according to claim 6, wherein said 
so five images are reflected .on said . linear image 

sensor almost at the same time and photographed 
by said sensor camera by. scanning at the . same 
time, and wherein the. five pictures thus obtained 
are sequentially processed. 
55 8. A method according to claim 1, wherein said 

processing of said pictures comprises calculating 
the form and s^es of said article from one or more 
pictures including said picture of said top surface 
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and classifying said article by size as well as 
extracting colors and damages of said article from 
said five pictures and grading said articles by color 
intensity and damage largeness. 

9. An apparatus for inspecting the appearances 5 
of articles, comprising: 

conveying means for transporting ball like 
articles on a conveyor one after another; 

shooting means provided with a sensor 
camera placed at a predetermined position above a w 
conveying path on said conveyor; 

a plurality of reflecting means which are 
placed at both sides of and above said conveying 
path at an inspecting position so that four different 
side surfaces of right, left, front and rear sides, and 75 
a top surface of said article being transported on 
said conveying path can be reflected on said sen- 
sor camera in array; and 

means for scanning and photographing the 
images of said different surfaces at every preset 20 
amount of movement in the running direction of 
said conveying means and processing the photo- 
graphed images or pictures. 

10. An apparatus according to claim 9, wherein 

said conveying means comprises a chain conveyor 25 
which has a conveying path in the same continu- 
ous plane in the running direction, and transports 
said articles spaced at random by not smaller than 
a predetermined distance. 

11. An apparatus according to claim 9, wherein 30 
said sensor camera in said shooting means con- 
tains a linear image sensor. 

12. An apparatus according to claim 9 to 11, 
wherein said plurality of reflecting means comprise 
twelve reflecting means placed at both sides of and 35 
above said conveying path to reflect the images of 

said four different side surfaces onto said sensor 
camera, and three reflecting means placed above 
said conveying path to reflect the image of said top 
surface onto said sensor camera, so that said five 40 
images are reflected in array on said sensor cam- 
era. 

13. An apparatus according to claim 9 t wherein 
said means for processing said pictures comprises 

an operation processing part for calculating the 45 
size of said article at a specified position from said 
picture of said top surface as well as the size of 
said article in the height direction from said pic- 
tures of said four side surfaces, and classifying 
said articles by size based upon said calculated 50 
values of said sizes; and 

an operation processing part for extracting 
colors and- damages of said article from said five 
pictures and grading said articles by color intensity 
and damage largeness. 55 
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© Method and apparatus for inspecting the appearances of articles. 


© A method and apparatus for inspecting appear- 
ances of articles, comprising reflecting images of 
four different side surfaces of an article (2) being 
transported on a conveyor (1) on a plurality of re- 
flecting means arranged above and at both sides of 
a conveying path on the conveyor (1) to transmit the 
four images onto a sensor surface of a sensor cam- 
era (3) respectively, reflecting an image of a top 
surface of the article (2) onto the sensor surface of 
(V) the sensor camera in the array with the four images, 
^and scanning and photographing the images of five 
different surfaces of the article (2). formed on the 
J~ sensor surface of the sensor camera (3) by the 
00 sensor camera (3) at every preset amount of move- il:t 
M ment of the article/ (2) synchronized with the con- • 
2§veyor (1), and processing, the : photographed images 
^so as to measure and " inspect . forms, sizes- and — . 
q surface conditions of the article (2) by using only . 

one sensor camera (3) at the same time. The meth- 
^-od and apparatus can cover five of the six partial 


surface of an article (2) reliably in the inspection of 
surface conditions. 
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lower, of an article, that is, 5/6 = 83% of the whole 
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